89-6 27 June 1989 


The attention of many software developers has shifted to multi-user systems. 
These are not your multi-user systems of old, where a host controls a multi- 
tude of terminals, or even your new multi-user database, passively serving 
the ad hoc requests of several users, but distributed systems where individ- 
ual users and applications act independently to produce results in concert. 


SELF-ORGANIZING SYSTEMS 


These systems are too complex and contain too many local interactions (both 
inside and with the outside) to be centrally managed. Instead they must be 
coordinated and self-organizing, with access to distributed information -- 
and underneath it all, good plumbing. Self-organization is a property of 
systems, not of their components, but it results from the interactions of 
those components. 


Self-organizing systems aren't new:  Con- INSIDE 
tention schemes such as multi-processor SELF-ORGANIZING SYSTEMS 1 
scheduling algorithms and Ethernet are Between stasis and chaos. 
ubiquitous examples of non-hierarchical, SOME EXAMPLES 4 
coordinated systems. Reliable Water, thINKer. 
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Yet only a few commercial systems vendors Borland's VROOMM, Corollary's - 
have studied their theoretical underpin- 386/smp, Maxis' SimCity, * 
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tems. This makes sense: Such systems Key Logic. 
self-organize whether developers intend SOME PLATFORMS 
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long-run this paradigm (sorry, but that is the correct word) has profound 
implications for the design of large-scale unattended systems such as Reli- 
able Water's desalination plant (page 4) and for groupware. The fundamental 
prescription is that these systems should be collections of agents, not cen- 
trally controlled applications that directly manage local activity, although 
they may well use à traditional database underneath. In other words, auth- 
ority is delegated to autonomous applications (or agents) that negotiate or 
interact with each other. The central system can manage the data and define 
the rules, but it does not determine the activity of the individual agents 
(just like a proper laissez-faire government; page 29). One benefit to de- 
velopers is that the programs they write need deal with only a subset of the 
whole system -- although the effects, good or bad, propagate globally. 


Yet another crackpot idea? 


Like art, self-organizing behavior is hard to define precisely; it's easier 
to discuss its characteristics and specific implementations of it. In es- 
sence, it results from the ability of interacting parts to create orderly 
systems out of chaos, in a world where the theory of entropy says that 
things inevitably get more and more disorderly.  (Self-organizing systems, 
of course, take energy out of the environment to do their self-organizing.) 
You seem to get more information and structure out than you put in; seem- 
ingly simple equations or objects can produce complex, unpredictable pat- 
terns. The best way to predict them is by actually running a simulation. 


Simulations will come in handy in predicting and determining how applica- 
tions and modules will interact as we build both new and old modules into 
ever-larger interconnected (and thereby interacting) systems. Just as mar- 
kets of multitudes of competing independent agents allocate resources (more 
or less) efficiently, so can self-organizing computer systems probably run a 
complex environment of computer systems more effectively than central con- 
trol could. But that hardly means that any relatively stable state is op- 
timal -- far from it. The tweaking and external controls that help to nudge 
a system to optimality are the basic problem here -- and a perennial concern 
of economists and policymakers as well as scientists. See our discussion of 
markets (page 17 to 19) for more on this topic. Nor do all systems of 
agents self-organize: Some stay inert, and others disintegrate into chaos. 


The principles in action 


Self-organization occurs with all kinds of objects: cells in a body, bees 
in a hive, people in a society, cars in traffic. The objects needn't be 
alike: It also applies to differentiated cells in a body, competition among 
species, relations between buyers and sellers or host and parasites. There 
are other familiar strains here: Object-oriented programming. The free 
market system (a special. love since our return from the Soviet Union). 
Agents and demons. Evolution and ecology. Yield management (see Release 
1.0, 88-2) -- which is airlines' attempt to participate in a market of inde- 
pendent customers with different strategies, mostly levels of price- and 
time-sensitivity, instead of treating them all as average. On the following 
pages we explore some more examples. 


EXAMPLES -- PAGE 4 


> 
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Why it matters 


e An early sign of formal interest in the computer implications of self- 

Noy organizing systems was the conference on emergent computation spon- 
sored last month by the Department of Energy at Los Alamos National 
Labs. "Emergent," a confusing word in this context, refers to the 
emergence of complex, unpredictable patterns from the iterative inter- 
action of seemingly simple rules -- that is, self-organization. 


"Emergent computation" can be used to simulate natural systems, or it 
can constitute a working computer system itself. An exciting aspect 
of emergent computation is that it's cross-disciplinary, with contri- 
butions from hackers, physicists and neurosurgeons, to say nothing of 
demographers, statisticians and pure mathematicians. Traditionally 
the province of physicists and biologists, the concepts and biological 
metaphors of self-organizing systems offer useful models for the de- 
sign and implementation of products and services to exploit the grow- 
ing market for multi-user, dístributed systems. 


Because self-organization generates complexity and is a property of 
systems, not of their components, examples of self-organization don't 
scale down well. The best examples are things such as bee hives, 
ecosystems and the interacting cells that constitute living animals -- 
or smoothly running traffic systems such as wide-area telephone net- 
works, the rural highway system or most Ethernet networks and other 
distributed systems. 


Examples covered here include Borland’s VROOMM (page 8), which lets 
interacting code modules monitor their own priority for memory manage- 
ment, and Corollary's 386/smp (page 9), which has a self-management 
approach for multiple 386es. The product that is likely to make many 
of these concepts clear to a mass market is SimCity (page 10), a city 
simulation for under $50 on the Mac that illustrates the complex in- 
teractions and feedback loops of factors such as population, business, 
housing, crime, taxes and pollution. It also illustrates that systems 
can "work" (self-organize and act coherently) without working well. 


The present is an enormously fertile time for these concepts, because 4 
we are moving into a world of interconnected systems that need them, 
and we have the computing power (Connection Machines and such) to sim- 

ulate them first. The basic question -- with many answers for many 

situations -- is: What simple local rules and behaviors generate the 

desired behavior in the larger, self-organizing system they consti- 

tute? While the best of these systems can handle change and error and 

accomplish complex tasks more effectively than a system that's pro- 

grammed by hand, their parts still need to be programmed by hand. 

There's no magic! 


This discussion is not so much a prescription for what you should do 
as for what you should think about -- a description of what is happen- 
ing regardless in a world of interconnected, interacting systems. It 
explores the issues governing the behavior of large-scale systems -- 
systems where the cost of keeping track of all the components over- 
whelms the benefits -- and where interaction occurs on a local basis. 
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Of course, developers aren't all going to go off and grow software. Nor are 
we going to use these ideas in rebuilding existing accounting applications 
or databases. (Large doesn’t necessarily mean complex.) But they might be 
used to allocate the computing resources to process these applications. 


In terms of applications, computer-based self-organizing systems control 
only their own "environment" -- the computers they reside on and representa- 
tions of the devices they control or monitor. So the obvious tasks to apply 
them to are network/resource management, as well as design (page 19), simu- 
lation, modeling and process control. For example.... 


RELIABLE WATER COMPANY 


What is a self-organizing system? The first large-scale, commercial self- 
organizing system we know of is the water-desalination plant recently un- 
veiled by Reliable Water Company, RW-2. Reliable Water is a five-year-old 
concern co-founded by Ed Fredkin, former head of the MIT Computer Science 
Lab and a scientist noted for offbeat theories that confound traditional 
Scientists by making sense. 


RW-2 works without human intervention (except to turn it on). It is run on 
two 8-megabyte Mac IIs by REX, an integrated software system designed with 
the G2 process-control expert system development tool from Gensym, also co- 
founded by Fredkin. It operates with what Fredkin calls "machine instinct," 
and what we would call a bunch of autonomous cooperating agents. 


REX itself would be far too complex to program as a traditional expert sys- 
tem, with rules tíed to specific pieces of equipment, let alone in the tra- 
ditional procedural way. Instead, most of the specific knowledge in RW-2 
sits in a knowledge base of passive object classes such as valves, pumps, 
filter membranes and the water itself.  (RW-2 knows enough about valves to 
calibrate a new one when it is added to the system and has already done so, 
says Fredkin.) These objects are hooked up to sensors monitoring the real 
thing, and supply their data to the software system. The system's layout of 
pipes was entered as a diagram that the tool could interpret. 


In addition, there are about 100 generic rules, or active agents (a number 
that will continue to grow as Reliable Water's engineers keep tinkering), 
which manipulate the data objects and actually run the plant and keep its 
operations within tolerance. The agents have individual goals that combine 
to make the plant deliver clean water while meeting a range of constraints: 
safety, efficiency, maintenance of the plant, etc. They have rules for 
working with each other and for monitoring and controlling pressure, temper- 
ature, electrical currents, salinity and other parameters of the equipment 
and materials in the plant. Some care about current operating concerns; 
others consider the long-term impact of the short-term measures taken to 
keep the plant operating despite small-scale equipment failures or malfunc- 
tions. They also generate management reports and instructions for human 
maintenance engineers, and test the system after repairs. When readings 
disagree, the agents can compare notes. 


While G2 (written in LISP) doesn't use the word agent, it has something 
called "focus," or collections of rules evoked when an unusual event hap- 
pens, such as a power failure or leak. Agents performing other tasks con- 
tinue routine work while the focus agents decide what to do -- stop the 
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plant and determine the cause of failure, fix the suspected item, test it, 
and so forth. Call them cooperating expert systems. There is no single 
point of failure in the software; each agent should be covered by several 
others if its task is not done properly. Says Fredkin: "It encompasses 
everything. An animal in the jungle doesn't go out on a paved path; it's 
got to cope with whatever it finds." This early commercial system, mind 
you, is of a kind where the worst failure would be the release of salty 
water into a water supply; it's not about to blow up, deliver a first-strike 
attack or harm humans in any serious, irrevocable way. 


Nor was the system built overnight; in fact, it took five years to design, 
including extensive work on the reverse-osmosis process by which it desali- 
nates brine, and programming. To get many of the agents' rules and proce- 
dures, says Fredkin, "We had to live through the accidents." One clever 
trick: Put a salt sensor in the floor drain; any salt loose in the system 
is sure to show up there pretty quickly. Moreover, RW-2 has far more ma- 
chine sensors than an equivalent human-run plant would need. 


The ultimate promise of self-organizing systems is not to make complex tasks 
simple, but rather to automate non-routine, non-simple behavior. They do 
not replace (or assist) a single expert, but rather model the behavior of a 
large group of mostly cooperating experts. By eliminating human factors 
such as sleepiness, illness, competition (except regulated cost-minimizing 
negotiation for resources), etc., self-organizing systems should operate 
more effectively and reliably than equivalent human systems. 


Much of the work done by Reliable Water and Gensym at a pilot plant in the 
British Virgin Islands and a model in Massachusetts will be transferable to 
other kinds of systems, let alone clonable for an arbitrary number of 
desalination plants. (The company plans to field four more in the Cayman 
Islands and the Caribbean by December, at $350,000 to more than $1 million 
apiece.) The logic in REX that knows about valves and pressures should be 
easily transferable; so should many of its higher-level instincts/agents for 
keeping equipment in good repair, avoiding damage to humans, etc. Each of 
these must obviously be customized, but much can be done locally. (A man- 
ager can manage anything, right? Only the workers need to know much about 
the particular business they're carrying out.) 


thINKer revisited 


We wrote about a similar system of cooperating expert agents, without the 
conceptual context, in April 1986. That system, to manage page layout and 
other production processes for newspapers, was never commercially fielded 
because its vendor, Composition Systems Inc., was acquired and the project 
shut down. However, its principals, Mike Stock and Marvin Berlin, started a 
new company, Artificial Intelligence Technologies, which sells expert-system 
development tools akin to Gensym's. AIT is currently bidding on a couple of 
cooperating-expert systems, including a factory-automation system for a 
pharmaceutical company and a production system for a large publisher. "Our 
biggest problem in the old days was connectivity and database," says Berlin. 
AIT's Mercury system, however, has solved some of those problems with a 
tight SQL interface that lets it use distributed databases to manage infor- 
mation access across environments, whereas many expert system tools keep 
track of their own data -- with difficulty. 

MORE EXAMPLES -- PAGE 8 => 
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NEW WINE IN OLD BOTTLES: FAMILIAR TERMS WITH NEW MEANINGS 


(We'd hate to defend these in a court of law or worse, an academic 
symposium, but they should be useful in understanding the discussion 
that follows.) 


adaptation -- change, generally in response to circumstances, by any means. 
It's hard to program adaptation because the variety of circumstances is 
so great. (Also, if it’s programmed, is it adaptation, or simply 
response?) 


agent -- an autonomous application acting on behalf of another person or 
thing, with delegated authority. The agent's goals are those of the 
entity that created it. You could say that an agent is an active ob- 
ject with a mission, but agents are abstractions that can be imple- 
mented in any way, whereas an object has a fairly formal definition. 


application -- a generic, vague term for almost any kind of code that ex- 
ecutes a defined set of instructions. Or just useful software. 


class -- the generic form of objects (see across). Each object instance is 
a member of a class from which it derives its behavior (and perhaps 
some class data). Each object instance has its individual identity and 
data, which may come from a file or a database, or may be derived at 
runtime. 


competition -- when two or more agents with separate, perhaps conflicting 
goals attempt access to the same resources. 


cooperation -- when two or more agents with at least one goal in common work 
together to achieve it. 


evolution -- adaptation by means of selection, a form of self-organization. 
The individual components may or may not change; the system changes be- 
cause of the replacement of its parts according to some criteria that 
cause the system gradually to change character ín some way that fur- 
thers its survival and growth. 


expert system -- generally, a data-driven, rule-based application. It ex- 
ecutes non-procedurally but it embodies explicit, unchanging rules. 
(Of course, the rule could be to change its own code in such and such a 
way in response to certain conditions, in which case you might have a 
self-organizing system on your hands.) Because they need to be flexi- 
ble (if not adaptable) in response to a variety of conditions, agents 
frequently contain expert systems. How many rules does it take to make 
an expert system instead of a rule-based code module? When does a pro- 
cedural application contain rules, and when does an expert system con- 
tain procedural modules? It's a question of which one calls the shots. 


genetic algorithms -- algorithms for simulating evolution. They direct pro- 
grams composed of strings of subroutines to reproduce "sexually," gen- 
erally by splicing code elements together, so that individuals of suc- 
ceeding generations include code modules from both lines of ancestors. 
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The genetic algorithms also manage a selection process, so that the 
programs evolve to meet criteria set by the genetic algorithms. 


goal -- a specification for long-term success. Only people have goals in 
the sense of mission or purpose; agents have explicit rules and con- 
straints and instructions. Self-organizing systems seem to have goals, 
but that's a philosophical discussion.... 


markets -- self-organizing systems where the main means of interaction is 
competition and trading. While trading generally encourages more ef- 
ficiency than competition without trading, markets suffer from the 
"tragedy of the commons," or local suboptimal solutions where everyone 
would be better off if all agreed on some course of action, but where 
no one's individual interest is so served. Cooperation needed here! 


objects -- The traditional way of explaining an object is to say it's encap- 
sulated (protected) data that includes procedures that are the only way 
of manipulating the data. But to the outside object-oriented world it 
looks much more like a program; it has behavior (executing code) that 
may have some data (parameters) attached. An object has a protocol, 
which is the kinds of messages it knows how to respond to. The ideal 
agent has a broad range of protocols (or situations) it can handle, and 
the ideal self-organizing system can respond to anything. Active ob- 
jects stand around in memory and interact with other objects; they 
change things (and may do damage). Passive objects tend to do data 
collection and filtering, but they don't alter the data or change the 
situations they encounter. In the Reliable Water system (page 4), for 
example, passive objects represent the physical system elements; rule- 
based active objects (agents) manipulate them. Even passive objects 
may send messages to other objects, but in general their behavior 
doesn't have side-effects. (Finally, there are what you might call 
"dead" objects, where marketeers use the word object to describe rich 
data types that their systems can handle.) 


Some people use "instance" to describe a particular object, and use 
class to describe a generic object. This is clearer, but it smacks 
overly of jargon to some. 


self-organizing system -- a system of independent, interacting parts that 
shows regular patterns of behavior and adaptation generated by the 
parts' interactions. 


time -- an important aspect of all these systems. You can't adapt after 
you're dead. Time delays in dissemination of information and feedback 
have important effects on the ability of systems to self-organize ef- 
fectively. 


transaction -- an atomic instance of (steps in) an application, with a 
defined set of procedures or events to be accomplished and a means of 
maintaining integrity and closure (or rollback to the original state). 
A transaction transforms the domain it concerns from one valid state at 
the beginning to another valid state at the end -- hence the obsession 
with managing concurrency and conflict. Just as objects may contain 
other objects, so may parent transactions contain (or consist of) 
nested child transactions. 
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MEMORY MANAGEMENT:  BORLAND'S VROOMM 


Another example on a smaller, less visible but far more mass-market scale is 
VROOMM, Borland's new Virtual Runtime Object-Oriented Memory Manager. This 
system enables large applications such as Borland's new object-oriented ver- 
sions of Reflex (shipping), Quattro and Paradox (forthcoming) to operate in 
640K. Rather than extend memory (which requires users to purchase addi- 
tional memory), VROOMM builds a self-organizing memory management system 
that uses available RAM better, discarding small code modules, or objects, 
on a dynamically determined basis. (The data encapsulated in these objects 
is the code itself; any data they manipulated has been stored on disk or 
with the application's data structure.) Each code object keeps track of its 
own persistence priority. The priority is based on factors such as when it 
was last used, whether it was used to reach the current state of the system, 
and its interdependencies with other objects. For example, windows and 
menus are generally interdependent and loaded together, because menus are a 
kind of window and require the window code for much of their behavior. As 
memory fills up, the system kernel queries the objects to determine their 
persistence ranking, and sends the lowest-ranking object into the cache. 
(When the cache fills, the lowest-ranking item is deleted.) 


Most applications with memory management swap in or discard huge pre-deter- 
mined overlays up to 64K in size, which take lots of time to reload and con- 
tain much more code than the particular functions the user needs at any one 
point. By contrast, VROOMM lets the system load code in tiny, targeted in- 
crements. Performance degrades gracefully; as there's less space in RAM for 
code, swapping gets more and more frequent, but still takes only a second or 
two each time. Meanwhile, the application data can grow to take up almost 
all the space not required by the kernel. Obviously, such a system can work 
only if your code is divided into handy little object modules -- 2 to 4K in 
this case, which required complete rewrites of Reflex and Quattro (Quattro 
was redone anyway to incorporate technology acquired with Surpass). Paradox 
was already quite object-oriented under the covers and took to the new 
scheme easily, says Paradox designer Richard Schwartz. 


But it certainly wasn't easy, says Borland vp product management Rob Dicker- 
son. Borland can be quite open about the general techniques used, he says, 
because it took a lot of testing and debugging to develop the precise algo- 
rithms that would work effectively and the development tools to use them in 
a general way in other Borland products and for resale with language prod- 
ucts. Exactly how much weight should you give to an element used four 
cycles ago versus one used eight cycles ago? Which pieces of code should be 
loaded together? Defining the objects and the class collections (all the 
related objects typically used for a particular task) is a key part of the 
job, and one that's specific to each application. Borland originally con- 
sidered having the system retain information from session to session (to 
create "personalized software"), Dickerson says, "but it turned out that the 
biggest win was interdependencies. If a certain user rarely uses graphics, 
then it never loads the graphics-oriented modules, and they never show up." 


It's hard to quantify the benefits from VROOMM, notes Dickerson, precisely 
because it moves you from a no-choice situation where the software simply 
dumps and reloads code overlays to one where performance degrades gracefully 
in a granular trade-off as data takes over memory, and more and more small 
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chunks are removed in a sequence selected dynamically to minimize the number 
that need to be loaded back. 


Borland intends to use VROOMM in 0S/2 versions of its applications and offer 
its facilities in language toolkits as well. 08/2 doesn't give you more 
memory; it simply gives you access to more memory if you have (or buy) it. 
As people start running several applications simultaneously in 08/2 with fi- 
nite amounts of physical RAM, memory management will continue to be impor- 
tant. The possibility of optimizing and sharing objects across applications 
-- not a function of VROOMM but an extension of its approach that will have 
to be coordinated with 0S/2 -- is exciting. 


MULTIPROCESSING:  COROLLARY'S 386/smp 


One frequent use of self-organizing coordination schemes is in bus manage- 
ment, multi-processor scheduling and other distributed-systems tasks.  OEM 
supplier Corollary is using such a scheme in its 386/smp, an add-in multi- 
processor system used by Zenith and other companies in their own high-end 
UNIX systems. To applications and programmers they look like fast 386 sys- 
tems that run SCO Xenix, but inside, the 386/smp replaces SCO's UNIX kernel 
(while keeping all its utilities and drivers) with a new kernel that sets up 
& self-organizing scheduling system among up to ten 386 processors. "There 
is no way for a central controller to know what's going on fast enough" to 
allocate work efficiently, says Corollary president George White. Formerly 
with Computer Automation, Western Digital and Texas Instruments, White 
founded the company in 1985. His goal, he says, is to resist the temptation 
to put his computer into a box and to continue selling boards to other 
vendors. That way he can concentrate on performance rather than position- 
ing, and use whatever schemes work underneath the hood without having to ex- 
piain them to end-users, as follows: 


To maximize coordination and minimize overhead and private use of code and 
data, the processors all share a global 64-megabyte memory on a high-speed 
bus (which doesn't work for geographically dispersed systems). Each pro- 
cessor looks to the system run list for the next available task when it fin- 
ishes or suspends work. To minimize traffic across the bus, each processor 
has its own 64K cache for the data it's working on, and has a bias to tasks 
it's done before so it doesn't need to load new code or data. Then, in a 
feature called coherent caching, each processor board contains an agent to 
watch the bus and intercept any calls for the data in its cache, so that the 
call can be diverted to that cache rather than get the old version from the 
main memory. The 386/smp includes one processor attached to an AT bus to 
handle any AT peripherals the user may have. In addition, the multiple pro- 
cessors may have their own peripherals directly connected, and the system 
can be configured on installation so that any given processor favors tasks 
that use its particular peripheral. 


This sounds rather complex -- but that's the whole point. By observing 


simple rules, the processor agents can carry out complex overall behavior 
that allocates the system resources efficiently. 
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EMERGENT TROJAN HORSE: SimCity 


SimCity is fixing to be this year’s hot game -- and perhaps the application 
that illustrates (rather than explains) the principles of self-organizing 
systems to the mass market. Positioned, and eminently enjoyable, as a game, 
it lets the user construct a city or play with any of seven model cities in- 
cluded in the package. The user has a budget and has to cope with a variety 
of familiar challenges, as well as optional monsters and unpredictable dis- 
asters. The user can build industrial areas, raise or lower taxes, hire po- 


lice forces, replace roads with mass-transit systems -- and query the system 
at any time for a citizens’ poll on his performance. But nothing he does is 
simple -- high taxes cause businesses and residents to move out; economic 


growth puts pressure on resources; police protection costs money. Quite 
apart from random events the developer threw in (including nuclear plant ex- 


plosions although no nuclear power -- as opposed to weapons -- plant has 
ever exploded), the system is unpredictable because of all these depen- 
dencies -- a/k/a/ object interactions. 


Experience seems to be that players initially enjoy zapping their cities -- 
and then quickly discover that it’s more fun trying to keep them alive. 
"It's like looking at an ant farm and poking it with a stick," says develop- 
er Will Wright, 29, who spent three years developing the program to its cur- 
rent state and has studied countless books and papers on urban planning. 
"Pretty soon you decide that’s no fun. There’s no challenge. You want to 
build a city; that’s a challenge." The basic message is that cities are 
complex, living things and there's no simple way to score performance. 
Wright asks, "Why do you want me to tell you what the score is? But maybe 
you could put in your goal when you start playing, and measure against that 
-- eity size, or the poll of residents..." 


In about 130K of C code, SimCity contains algorithms for 13 to 14 spatial 
arrays (maps) for data such as crime rates, land values, pollution and popu- 
lation, as well as 300 or 400 other interacting variables; call them ob- 
jects. The system is especially complex because of this two-dimensional 
aspect: You don't just have a crime rate, but a map of where the criminals 
hang out and how they're affected by the presence of police, parks and other 
spatial elements. Many of these factors also have feedback loops: Crime 
drives down land values and attracts further crime -- unless you do some- 
thing about it. Says Wright: "We encode the behavior between the elements 
and then we just let it run and the system's behavior emerges." 


All things considered, 130K for the simulation is a small amount of code -- 
and initial complexity. It's the behavior that's complex. Imagine trying 
to code such a system procedurally or even with forward-chaining expert- 
system* techniques. It takes almost twice as much additional code -- and as 
much CPU time -- to manage the graphics and animation and other features. 


Response to the game has generally been favorable even among professionals 
and academics. "Most of them want access to the algorithms so they can 
tweak it a little," says Wright. "It would be great to have it used by peo- 
ple who really know what they're doing. We're trying to Trojan-horse the 
education aspect, and it seems to be working." 


Available at a store near you! On a Mac!! Under $5011! 
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TRAFFIC CONTROL: TEXAS INSTRUMENTS' ComMUTE 


One of the obvious uses of simulated self-organizing systems is in traffic 
control. The application is not using the systems to control the traffic, 
but using them to model and simulate the results of various local rules so 
as to design better traffic-flow systems. One such project, ComMUTE (for 
Computationally Metabolic Utilitarian Transportation Ecosystem), is underway 
at Texas Instruments' Dallas AI Lab, where two researchers are working to 
"get over the bottlenecks of central management, explicit control and top- 
down design with emergent computation," says researcher Marek Lugowski. 


He and colleague Duke Buster are building simulated vehicles ("rho-dents," 
using the Greek letter for r) that crawl over grids to reach their destina- 
tions. Armed with about a page of LISP code (the environment takes a lot 
more), they start with two coordinates each and modify those coordinates to 
simulate travel. Their "goal" is to reach the destination coordinates, and 
they may not move to spaces occupied by other vehicles, which they can't see 
coming until they're in the next square in the grid. Over time, they learn 
to do this in a relatively efficient way. They work with some rules about 
avoiding occupied spaces and build an internal representation of the grid -- 
a map of their environment -- based on previous collisions. The information 
in the map decays, so that it can be updated with more recent experience and 
singular experiences wash out. In one simulation, with the destinations 
lined up along an axis of the grid, the vehicles learn to approach their 
destinations head-on in a way that minimizes collisions. Better yet, they 
readjust within 10 to 30 iterations after the destinations are shifted. 


So far, ComMUTE is strictly experimental, but TI is funding it in the hopes 
that something commercial may come of it. (That's how Speak'n'Spell got 
Started.)  Lugowski, a four-year veteran of this area, has visions of air- 
ports without control towers, but TI will probably apply the approach first 
in such mundane (and less risky) uses as directing forklifts in a warehouse. 
Says Lugowski: "The problem with traditional AI as a solution is that it 
doesn't scale up. Things get too complicated and vulnerable to flaws." 
Simulations show that simple rules such as the vehicles' work independently 
of the total system's size. (The local ratio of rodents per grid area, how- 
ever, has an impact on performance: You can't simply increase the number of 
rodents without giving them more room to run around in.) This makes intui- 
tive sense too: Since all the vehicles know about and interact with is 
their local environment, the overall size of the system couldn't have any 
impact on their performance in avoiding collisions. But will they be as ef- 
fective in getting to their destinations on long trips? 


SELF-ORGANIZING OPERATING SYSTEM: KEY LOGIC 


Last year we wrote at length about Key Logic's KeyKOS, an object-oriented 
operating system that provides extremely high security and efficient execu- 
tion by packaging all its functions -- including emulation of traditional 
OSes such as UNIX and IBM's MVS -- as objects. After some financial and 
management commotion and a venture refinancing, the company has regained its 
bearings. Although still in start-up mode after four years, it is now call- 
ing on commercial customers jointly with IBM under a Complementary Marketing 
Agreement. It has also licensed the software to a large software vendor 
that plans to use it as the foundation of a communications program for 
resale. For further details, see Release 1.0, 88-5. 
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SOME PLATFORMS 


For now, most vendors are simply working on creating the kinds of multi- 
system environments and tools that will let multiple user and agent applica- 
tions interact, rather than building self-organizing systems per se. 
(Multi-tasking is de rigueur, so all these agents can operate concurrently.) 
The three major categories are databases of information about the components 
and state of the system (FileShare and Legato), cross-systems communications 
(Transarc and the Open Software Foundation's request for technology for a 
distributed computing environment) and programming tools that will help to 
build autonomous agents/transactions (Cooperative Solutions). Soft‘Switch 
and Hewlett-Packard's NewWave environment will ultimately provide some of 
all three. NewWave’s Object Management Facility, a platform that will span 
(at least) DOS, 0S/2 and UNIX, has garnered some support from the Object 
Management Group, a growing would-be standards group led by Hewlett-Packard 
(a key OSF founder). 


Overall, the platform/activity or central/local dichotomy sounds much like 
the division of labor between a database and the applications that surround 
it; the added idea is that the applications interact with each other. Dis- 
tributed databases, because they have solved all these problems for them- 
selves, give you the ability to build cooperative applications across plat- 
forms without worrying about these issues -- but only if you adhere to the 
database tool's restrictions. It's easy to push data around, harder to ex- 
ecute commands or send messages remotely. 


WHO'S ON FIRST? SAROS FILESHARE AND LEGATO SYSTEMS 


Saros and Legato Systems exemplify the differences between the OS/2 and UNIX 
mindsets. Although they have similar goals in mind -- building a system in- 
formation substrate to manage system-resource objects and possibly applica- 
tion objects -- they have come up with two entirely different approaches. 
Initially, Saros will be selling a cross-network file manager primarily to 
network administrators for use by end-users in office-automation environ- 
ments, whereas Legato will first sell a front-endless product to OEMs and 
programming teams who can appreciate the intricacies of its products. Both 
of them will eventually operate in the shadow of -- or support interfaces to 
-- X.500, the forthcoming (don't hold your breath) international standard 
for directory services, a sort of global database that will enable users and 
applications to keep track of system resources. across wide-area networks. 


Saros FileShare is one of the first OS/2 applications to show up -- and an 
SQL Server application to boot. But in fact it's systems software that uses 
the Sybase engine to accomplish the task of managing DOS and OS/2 files 
across a network. If you think of the world in the traditional form of 
layers you have to wonder how systems software can sít on top of all the 
other layers, but the modular approach puts such facilities side by side. 


FileShare was originally designed to be a general object manager by a highly 
technical crew of people mostly from Tandem and Microsoft. But its founders 
discovered that their customer set was uneasy enough at the notion of adopt- 
ing 08/2 servers, and didn't want to hear about objects and such. The cus- 
tomers had a real-world problem -- giving users access to files they should 
have access to, and keeping them away from files they shouldn't see. 
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FileShare allows users or applications to manage files by attributes -- au- 
thor, user, date, etc. -- as well as by as many key words as they care to 
use (and search). Because it relies on a database that manages the files 
(as well as other objects, such as users, workgroups, etc.), user adminis- 
trators can perform set operations -- delete all files last used before 14 
July 1988 that do not include the key word "IRS." Or transfer all files 
used by the WonderWidget workgroup to the archives; the project has been 
canceled. Individual users can control their own private files, but the 
system manages group access to them in ways specified by the administrator. 


FileShare thus lets almost any application function transparently as a 
multi-user application (aside from copyright issues) because FileShare takes 
over management of concurrent access to files and file-locking. In the 
short term, some vertical-market software vendors will be using it to manage 
files for their applications. As more and more application vendors support 
FileShare (which isn't a big technical challenge), getting to FileShare 
files from within an application will be almost as easy as it is now for DOS 
files, but FileShare does make the network visible in a way that network 
operating systems that let you use files off a server do not. The user has 
to find the file and store it locally before gaining access to it. 


FileShare's file-management services are extensive, giving users ways to 
catalogue and selectively retrieve files, and allowing system administrators 
to control access, back-ups, version management, archiving and other tasks 
with virtually all the power of SQL Server. At the user's option, a single 
file can be copied by multiple users and manipulated locally (with notice to 
other users that this is happening). When any user returns the file, the 
new copy is kept as a version of the original, so you have, say, 3A, 3B, and 
3C. .At:any point, those three can be logically merged in FileShare: the 
user has to do the work -- redlining and reconciling documents, say -- and 
then FileShare creates a single new Version 4 from the result. 


On beyond files 


Because it manages files, FileShare is the way dBASE used to be: An entire 
file is off-limits when any part of it is restricted; in other words, you 
can't lock records within a file, but just entire files. Of course, that's 
the province of a database manager, not a file manager anyway. Yet File- 
Share is really an object manager under its skin: With proper integration 
between an application and its underlying capabilities, you could just as 
easily manage objects for an application and provide smaller-grained con- 
trol, including locking records if they are so defined. (It's more likely 
to be used for database views or applications, notes president Wayne Car- 
penter; leave the records to the databases.) Other possible tasks include 
managing system resources such as printers, mailboxes. or application modules 
themselves anywhere there's an SQL Server to help keep track of things. 


For such extensions, the product will need to add application logic to deal 
with the particular services and operating environments it’s working in, but 
the fundamental idea of managing system resources will stay the same. Of 
course, it's a feature of 08/2 (and other advanced systems such as UNIX) 
that applications are composed of modules. Only a few of the modules need 
be task-specific; the rest are more general utilities that accomplish other 
parts of the job; and yet other modules are specific to the system platform. 
Typical of what we expect of many "OS/2" applications, such as Lotus Notes, 
FileShare is actually an 08/2 back-end linked to DOS front-ends. 
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Overall, we: think: FileShare will, be: pM Lf Saros can | find. al goaden waye lo? 
to sell and support it. It offers: -pe-users. (and their administrators) the. 

same services. taken for granted. in other: multi-user: eny tsonante bap not. vee 
ES addressed by pe LAN and: ETUR ied Vendors de pies 46] 


The UNIX X approach: .1 legato. 


FileShare operates: on 08/2 'servers oats o Although it can operate across" ^ "^: 
multiple ‘servers ‘transparently (so that: only ithe network “administrator needs::- 
to know where things are physically, and then only at configuration time), 

it is limited for now to tightly linked 0S/2 servers (despite its foundation .' 
on the widely ported SQL: Server) and hás code vapécific*to:08/2 and:DOS^Pila ^: «7 
structures and LAN: security. Legato Systems, a lO0-person VC-funded firm: ^^ 
recently started by. a group of former Sun employees, addresses Similar prob: 
lems for. the Peace end Amore: pn pens Cire Ves worlds : 3 iis 


Their: isst is. similar to | FileShare' "M to provide: an. S undebiy NS facility cs 
that will enable users and applications to ignore the intricacies of network - 
layout.and.accessibility. Legato, however, is initially going after pro- ^ ^ 
grammers and developers rather than end-users, since that's where the: “action 
is. Its first product is Prestoserve, a server ponor manca sennanee: "Hiat 

d a techie: could: love: Eier R sU cate JAUNS Geni Se Sees 


Like FileShare, Legato! s „future misse: wilr: use “a naie but: one- ove 
eled after the hierarchical system used in X.500.- Legato is interested in : 
being able.to.fit easily into the standards- sensitiv UNIX world; while *^ 
Saros is relying.on Microsoft and Sybase for standards for “now (although: ie 
uses.mostly SQL Server's transaction and integrity services, “and manages a- "EM 
lot of storage directly for efficiency).  Long-run; Legato co-founders Rusty ^ SREI 
Sandberg. and -Bob Lyon expect. they will be providing a kind of system fe-^ 75s EET 
source manager that will work with rather-than replace X.500. It will'ex- "^ 
tend it by providing tools for system resources to register themselves so 
that applications and users can find the most efficient resources that meet ™ ~~ 
specific criteria. In essence, it will provide a medium for publishing per- 
sistent information. -- such as the services available from à particular SUME 
printer.or the. applications: available on a. particular. ‘server --.as-well as ao? 
language. for. real-time inquiries, suchas "Are you: xcd now?" "anid oo ya EB 
have corporate, e MEL in: One: Og. put pins TII Uu VS m LE 


Although. the.underlying enie P PD Ieo intends: “initially to serr 
specific versions: of it for functions ‘such as printing, communications and ^ 
"a decent back-up-and-restore ‘sérvice across heterogeneous. 'epus e ‘emphasis 
on restore. rather than backup," says Lyon. "We want to ‘turn’ everyone into án = 
operator, just like they're-an operator of the telephone; by making 1t all^^5 94 
easy. and, consistent." It's likely to be a lot easier to sell than object: 
management...) 3e goes cus cis s cnt G GODS si wocYpDsg $$ USING mo WI 


Long-run, both these.companies will: probably be providing object ‘Management 
for self-organizing systems... In a world of many’: interacting objects/agent 
it may be hard.to. find the right one to: send: a: message to without the ‘ser- 
vices of some such global directory: :Legato's language will be one ‘means of 
addressing objects that: manage: Peripherals ‘such ‘as’ printers,’ fax machines © Iu 
and new.devices.of.the: future.: (Of: course; in the’ far distant future j t. 500: y 
will purs advance. to having : an: veces p ned database underneath » 
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TOMORROW/^S: TRANSACTIONS: -COOPERATIVE ‘SOLUTIONS. and SOFT: SWITCH M 


É In the self-organizing object-oriented eaten of cne future. dckive. aene 

uu will be.performing:real work (rather.than just searching: information.ser-i:c sY 
vices for: interesting... articles); and: developers: and susers:will: want: some way. + 
of defining: and: ensuring: the: integrity of the. work.they:perform; i.e. acway-c/- 
to define transactions; .Although.the.system.as a: -whole-may easily: adjust: SO cs 
the failure of/a: ‘transaction or: two,othe: "owner": of ‘thes: pec is: D eT toi 
be as Dru ond (omen Pii wes cd i T3 o 


These: dents can: represents) ‘users: cr Lupe to. accom ieee as 1 high: level task, Or: 
system agents. that: manage: resources, : deliver: mail: or: perform computations. 
(See glossary, page: 6.)».Just/as.:an object’ isan. encapsulated: plecesof..datas:.” 
with some methods. or- behavior: accessible:.externally,:so is» a.transaction-an fare 
encapsulation. of: a; unit.of, work, that..transforms,a: domain: from: one: valid .:: 
state to another..:.- "T venite MENT aa Qu^ musik van SE, “ee ee. Loy. ede ad 


The transaction's;behavior is visible.-externally,:and it,may:send messages sni 
to other objects.and.agents. anywhere on.the systems.to. accomplish. its work; 
but it. maintain integrity. of.action.over. time: just.as  an.object. maintains 
the. integrity of its.data... The. ;transaction either commits.or:is. rolled: 
| back. Thus... transactions. are. atomic activity,.with,logie: to. check and en-- ud 
| force. integrity. -No. outside. events. tr except for.those. explicitly part of. =i: 
the transaction. are. allowed to. interfere. with its. „behavior: (justas obs: 
jects. respond: only. to messages they. understand)... ook sc 


Time-stretched. fausactions. 


But the isadi onal tion of a ‘transaction. sees Jt. as an ee ee 
event: The state of the world outside is assumed to remain constant. In 
this sense, it’s much like a batch job, notes Soft:Switch:; president Mike: 


Zisman.  (Soft'Switch sells multi-platform E-mail tools and systems.) In 
fact, transactions, can. go.on: for: days., (also; an. issue. for. object-orlented:- 
databases; Released 0 86-1205; exemples, include. S of- li editing 


x e. Tocar ion: ‘and transfer. of high- level: Informations This: kind 
of back-end capability will be vital for agents: communicating asynchronous: ©": 
ly. E-mail treats the transfer as an atomic transaction with facilities for 
error-recovery,. integrity Reporting: etc. : d Im the case: DE Soft:Switch: and 
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purchase orders, invoices and the like. 


In order to build agents, people will in fact be building transactions -- 
atomic applications that accomplish a specific task and manage its integ- 
rity. One company addressing this issue is Cooperative Solutions, a start- 
up whose principals left Tandem last summer and started the ll-person firm 
this January after a long vacation. The company's aim is to enable users to 
generate transactions for the new environment where "applications may be 
smeared all over the network and have to adapt to resources -- database, 
agents, mail -- moving around too," says co-founder Kim Worsencroft. "And 
they still have to be atomic." Initially these will be mostly database- 
based transactions, but Cooperative Solutions will attempt to be database- 
and environment-independent. -- unlike most current development tools. 
"Object-oriented and transaction-oriented people come from different worlds, 
but we're trying to join the two," adds co-founder Dennis McEvoy. 


(The name of Tandem crops up quite frequently; it is one of the first com- 
panies to have truly understood the issues of cooperative processing, 
redundancy, transactions, etc. Indeed, one of the first independent-agent 
ideas was designed by Tandem's Joel Bartlett into its Guardian OS in 1975 -- 
paranoid democracy. If a processor failed and another processor noticed, 
the second processor would send a message to the administrator and blackball 
the failed processor. However, it wouldn't tell the other processors; it 
would let them notice for themseives -- which they would, eventually. The 
reason? What if part of a failing processor's behavior was to broadcast a 
message that another, healthy processor was failing? This scheme ensured 
that processors couldn't falsely denounce each other to the system.) 


OPEN WORLD: OSF AND TRANSARC 


The Open Software Foundation is well aware that selecting UNIX and a user 
interface isn't enough; the world needs a "Distributed Computing Environ- 
ment" to standardize upon. In fact, you might well argue that the distrib- 
uted computing platform is more important than the local operating system. 
It's important only that local systems can communicate, rather than that 
software from one system be able to execute on another one. (See Release 
1.0, 88-11.) OSF’s request for technology is seeking facilities for cross- 
system communications, allowing applications and agents to interact freely, 
including remote procedure call services, naming and authentication services 
(part of X.500), presentation services (data translation between environ- 
ments) and a distributed file system. These components will probably come 
from several vendors and will be sewn together by OSF next year just like 
the components of its Motif interface. 


A possible contender for the OSF's blessing is a forthcoming product from 
Transarc, a company recently funded by IBM among others and formed to 
commercialize the technology underlying the Andrew File System long in use 
at Carnegie-Mellon. The AFS implementation is also likely to be adopted by 
NeXT and of course by IBM, especially if IBM puts its support behind the 
NextStep interface/development environment.  Transarc clearly has the tech- 
nology for its first product, which will be a commercial version of AFS. 
Future products will handle such tasks as implementing transactions over 
networks, with special attention to security and nested transactions, based €— 
on CMU's Camelot, for CArnegie-Mellon Low-Overhead Transaction system. 
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SOME EXPERIMENTS 


Large-scale self-organizing software systems are still pretty rare. With 
the exception of Reliable Water Company's REX (page 4), the only ones we 
know of are research efforts. Two of the more prominent are the work of 
Danny Hillis at Thinking Machines, the company he founded, and Bernardo 
Huberman at Xerox PARC. Hillis is using the capabilities of the powerful 
Connection Machine he designed to model population dynamics and evolution 
and trends such as the spread of disease, while Huberman is more directly 
concerned with the use of self-organizing market-style systems to manage 
computer resources -- or what he terms "the ecology of computation" (the 
title of a book he recently edited on the topic). 


What's the difference between a marketplace system and an evolutionary one? 
One is probably simply the time scale; the other is that in evolution the 
agents are replaced over time, while in the market it's the goods or ser- 
vices traded and used by the agents that go in and out of existence depend- 
ing on demand for them (consider demand the criterion of survival in the 
market, but it's only the resources and market structure, not the agents, 
that evolve. (Of course, most systems are hybrids over the long run.) 


In the Hillis model,..adaptation of individual elements is the focus, whereas. 
in the Huberman approach the issue is the organization of the system and the 
allocation of resources. Interactions between the elements in Hillis's 
model are. simply competition for resources and high scores; in the Huberman. 
model, agents negotiate each other in structured auctions for a variety of 
resources. (Note: these are not different approaches to the same problem, 
but different problems and different approaches that are both part of the 
broad field of self- -organizing systems.) T 


BERNARDO AND THE MARKETS 


Perhaps the most visible simulated market system is Spawn, the work of Hub- 
erman and his colleagues at PARC. Huberman is a former physicist who worked 
in chaos theory early, and has now moved on to self-organizing systems. 
Spawn is a computational "ecology," running mostly on networked Sun work- 
stations, which has attracted considerable press attention of late. It 
enables PARC to make use of idle computer time through market allocation of 
processor time -- and of course to study the effects and effectiveness of a 
variety of algorithms for doing so. 


Huberman takes a rewarding physicist's approach, focusing on experiments and : 
measurements, and he's getting interesting results. The system has been up 
just a few months and produced the results described here, but it's not in 
general use: It’s still easier to simulate than deal with the network's 
cryptic reporting interface and occasional failures. (Guess we need a self- 
organizing system to maintain as well as allocate resources.) The initial 
observations are hardly surprising: It takes only a few agents competing 
for resources to establish "rational" prices: That is, time on a machine is 
proportional to its performance, so that price-performance is E 
constant, Prices rise in response to shortages. or high demand. -And so... 
forth. The efficiency of allocation is close to optimal. 
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Forum: golf shirts, they lose their cachet. CPP. Juan follows Alice's lead. and. 
becomes a manager, who's left to do the work? Some’ resources become more” l 
valuable if everyone uses them, like a popular movie (as long as you can get 
in) which is easier to talk about if others have seen it, while others Pee 
come” less. Valuable: `` B so crowded: no one d thera” anymore. H Made 


But most: — is“ the so- -called. netagedy of' “the commons , " the fundaimen- : 
tal' problem we attempt to solve "with government ‘actions. This is the issue ii 
of sharéd resources: - ‘Everyone is better off if everyone pays, but. ‘each’ ta 
dividual agent is better off if he doesn’t pay and mooches off the other. ' ~ 
In other words, how do we get global optimization when it's in cotitradiction 
with local optimization. The same issues apply to long-term research in the 
face of stock-market pressures; competition among "firms in the face of ex- ' 
ternal threats from other countríes, the confusing: interpláy "between saféty' ü 
nets:and incentives in our welfare system and most current puzzles dn public 
policy; (Tó:see:some of them played out, try playing SimCity; page 10.) ^ 


There is much: interesting’ discussion. of market systems in the work of Mark^ 
Miller ‘and: Eric Drexler in Huberman’s and Drexler’s books cited on page: EER 
Miller: is+ (currently: chief architect at Xanadu, now part of "Autodesk; He” HS 
working: there’ on’ building a^ back-end text^database that’ will: ultimately play 
host. to’ a:variety of front-end agents that will not just search- it’ ‘but also” 

annotate .:it,::link: cross-references® and: PHI editorial: assessments: of ts 
contents;':More on:this next i$sue. 5 : COIV P5 eis 
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The contrasts between SQL; "thé: dangüagé of -datababes? ‘ind prices, 
language. of markets; may- be“ illuminating.» "SQL is Boolean and' deter- 
ministic: and! discrete: “Get me: such and such. records, that meet ' ‘such: 
-and: such: precise criteria: Pricing; by contrast, Kegards things as“ 
«fungible: I want*so much of whatever meets, more or less, these gen 
-i eral- criteria. The particular identities don't matter, and you. can 
¿trade $10: of: this: for $10 of: that. without theoretically changing my 
<ohappiness (ex: transaction costs). “SQL is about“ identity; prices are Wy 
about functionality: SQL” is^ digitali prises are’ “analogue. © “SQL 
regards. the. world as tables; prices regard it as a fluid, shifting 
mass where one thing can replace another. 


RENETICS ALGORITHMS TEROCRAMMING: BY EVOLUTION © 


Evolution: de: a means’ of P adaptátioni A Populacion evolves' as dts members are. 
replaced by’ new and different ones; the individual elements don't necessari- 
ly adapt.-:Evolution:works^ by selection:- Successful elements (and thei Aun 
traits: and: behaviors): survive’ and reproduce. "(Success may pe” ‘det : 
ability: to: get: food and: sexual partners, or to 'earn a living, or to ‘acquire _ 
a specified. level of currency ór:resource access “ina: computational System. PH 
Unsuccessful-elements-die out, taking their traits and behavior "with them. 

Over. the. id Tun, T ISUCEBSEERE: S snente Ana ‘traits “‘predowinate oe 


There de a. jscehing difference UstusEn. traditional Sótutfohaiy' ‘systems, 
where individual elements are created and die out according to their success 
in meeting goals, and systems where the individual elements persist, while 
their behaviors or problem-solving techniques die out or flourish. But in 
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fact, it's merely a matter of mechanisms and metaphors. In a market-based 
software system, certain algorithms and resources might get used frequently, 
and others might "die" of neglect. 


Will management then pour resources into making the widely used algorithms 
even more efficient, or making popular application programs available to 
more users? At this point, evolution in the software industry is working 
mostly at the macro level in this way, determining the marketplace. success 
of operating systems, platforms, hardware architecture and applications. 
(Criteria for success include things such as marketing and management sta- 
bility as well as the technical capabilities of the products.) 


Market systems are exotic and scary enough to the traditional object- 
oriented programmer, who has to relinquish control of the executing applica- 
tion. A related but further-out notion is the idea of genetic algorithms, 
which leaves even the design of the programs up to a self-organizing system. 


Genetic algorithms are algorithms for building sequences of subroutines 
(analogous to genes) that reproduce and mate, resulting in ever more effi- 
cient solutions for a given task (or for changing tasks, for that matter). 
This results in evolution, where the solutions change by replacing- them- 
selves over time. The genetic algorithms are not the solution algorithms 
themselves, but the programs that manage the rules of reproduction, genetic 
recombination and selection. In other words, they're the.program running 
the simulation. 


Typically, the program treats the solution algorithms as strings of text 
(code subroutines) with designated breakpoints where splices can occur.» 
"Children" are created by joining spliced halves from two parents. Selec- 
tion is made by actually running the child and scoring its solution of the 
problem -- typically some kind of optimization problem. .Most genetic algo- 
rithms produce. succeeding generations of solution strings of the same gener- 
al form and length, but relaxing those constraints with so-called "messy al- 
gorithms" tends to produce more rapid, effective evolution: towards superior 
performance, says Dave Goldberg, an expert in the field at the. University of 
Alabama. "We've taken our cue from nature, where evolution has carried us 
from a small number of genes per organism to many with good results." 


Stuffed software 


The implications for software development long-run are promising; GE Corpo- 
rate Research is using genetic algorithms in jet turbine design and reported 
promising results at the recent genetic algorithm conference --:reportedly a 
2 percent increase in efficiency. But genetic algorithms are unlikely to 
see much use outside the design lab for a while; few dp managers-are going 
to trust algorithms of uncertain parentage. Emergent. computation and:genet- 
ic algorithms in particular merge the notions of design and runtime, since 
it's a permanently incremental approach where the system is always in flux 
(or alive). But there's no reason that you can't use emergent principles  - 
for a period called "design," and then remove. the genetic.capacity to create 
a runtime system (regardless of what the purists might think). If you do it 
right, you then end up with inanimate -but still executable RoEtvare: 
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EVOLUTION: DANNY DISCOVERS SEX AND PARASITES 


£3 Danny Hillis, founder of Thinking Machines, turns out to have built an ideal 
d machine for running genetic algorithms. He has been using his own Connec- 
tion Machine and his limited free time to build self-organizing evolutionary 
simulations, modeling other people's ideas that ran too slowly elsewhere and 
also coming up with a few of his own. First, he has built a system that can 
evolve a sorting algorithm that comes within one step (60 vs. 61) of the 
best humans can do for sorting a list. (The algorithms consist of 64 se- 
quenced instructions to compare and exchange a particular item in the list 
to be sorted. Each individual gets a random list to sort, and is scored on 
how well it has sorted the list by the end of the 64 steps.) That's pretty 
impressive. The whole thing took 100,000 generations, at about 10 genera- 
tions per second for this model. 


There are different ways to score to determine survival, and to generate 
successive generations, which both have a strong impact on the model. 

Scores on the problem represent the environment, in the sense that it's what 
the individuals are adapting to. The simplest method is to take an arbi- 
trary percentage of the population with the highest scores., Another is. to 
assign arbitrary survival probabilities to specific traits, which is how 
population biologists generally do it. 


The problem with either of these scoring methods, of course, is that they're 
static. They end up producing a population specialized for a particular en- 
vironment. But a changing environment is closer to reality, and adaptabil- 
ity, rather than specialization, is key to survival over time. (That's 
certainly the case with humans, which aren't particularly good at anything 
except intelligence, which equals learning, which equals adaptability.) 


C 


Populations may get stuck in a local adaptation (specialization) that’s 
counterproductive in the long run. It turns out that parasites -- other ob- 
jects that evolve more rapidly because their generations turn over faster -- 
can counteract the tendency to inertia. Any time a particular type gets too 
prevalent, it becomes an especially appealing host for parasites and is pre- 
vented from overrunning the population entirely, leaving enough diversity in 
the system for it to respond to new conditions. In other words, parasites 
keep populations from complacency, and may shake them out of suboptimal 
solutions to further improvements. 


There's also the question of just how to elicit and spread a diversity of 
elements for the selection to work on.: It turns out that exchange of genet- 
ic matter is generally far more important than mutation in keeping a popula- 
tion of complex things diverse. Mutations are less and less likely to be 
beneficial as an individual gets complex, whereas sex allows variations that 
work to be passed along and spread throughout a population. Sex is a means 
of what Hillis calls "idea-sharing." Sexual reproduction is’ simulated by 
recombining genes (represented as sections of the code strings) according to 
some specification to generate a new generation. (Although the pairing of 
any two individuals, or gene pools, is likely to result in a more "average" 
individual than the more extreme one, it also spreads its extreme character- 
istics more broadly than would simple cloning, or asexual reproduction.) 


Many variations may sit around in the population "doing" nothing, but when 


=) conditions change somewhere there’s likely to be a set of individuals better 
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suited to the new condition: As thay mate with less favored iadtvidusig Ce"? 
they may help the population survive. Or if they stick to themselves, this 
small group may flourish and grow larger as the rest of the population ' d 
flounders: Mating behavior -- random, pick your relatives or pick someone 
with’ similar’ string patterns are common _ Strategies’ cde another im int. 
characteristic on. à model. PUNE a 


Gps in the taper” PES 2 TW dmn 


But most Ineca are "Billie! s theoretical insights dicdddtag: the work kof 
others in the field, as described in his unpublished paper "Punctuated © equi- 
librium due to epistasis in simulated populations," which has traveled wide- 
ly on“ the’ samizdat circuit. (A fine example of the cross- ‘disciplinary na- 
ture of this field). In essence, it offers explanation for the strange gaps 
in fossil records, which indicate that evolution is not a slow, steady pro- | 
cess, but rather a sequence of quick swings from one prevalent phenotype Ad: 
(trait or behavior) to ‘another, ‘or “punctuated ‘equilibrium." > There's only 
short“ intermediate period as the majority m a pops sero ‘switches over. 


The reason, as ‘shown’ by Hillis’ S ‘simulati n 
result of a single gene; but' of a “number of g 
lier simulations which looked at genes and phenotypes as aquivarent | (which © 
used a single gene rather than several as a criterion for survival) missed 
this point. [But simulations that use survival criteria based on tlie €vo-' 
occürrence of several genes (e. [P subroutines: that work well together) 
mimic: the’ reality of ‘punctuated quilibrium. Those genes may b H 
around individually in the population with little noticeable effec | on i 
vival rates. Chance combinations of the favorable genes (with high survival i 
rates) slowly raise their frequency in the overall population until they ^ 
reach a critical mass -- and suddenly blossom. "Any small increase in the | 
frequency of'oné- .;. will greatly enhance the selective values of the - an 
others, and vice s versa," vrites Hillis: (with ë a “Breet deal of supporti g 
mathematics): pm 


Theatre of the emergent n 


As biology; Willis’ S simulations lack a YpféSentetión t of spatial migrat < i 
-- and no”doubt other items too. But they can show some. exciting patte S e 
of reality without modeling all its aspects. ° v ue He 


As theater, they vary dn. what” they show on the screen. The: computer can 

create populations of an arbitrary number of elements (call them objects), a 
executé their’ behavior and. then, ‘based on the results, decide whether they 
survive or not. : You can’ display them : as 1 t re 


It takes: change” and? aivérsity -I- the ‘aguivalent’ of "trei the ioco n 
a moving ocean instead of static hills -- to make sure that the climbing di 
continues. In real life, of course, circumstances are always changing. 
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SOME PATTERNS 


As you look at self- organizing systems, some interesting insights "emerge." " 


e ` "— ‘systems: self- -organize by themselves (by definition), there' a^ 
Ho ge" ‘lots of work teft for the designers of their components; m nute -. 
variations and nuances in the components can cause. large, unpredictable. 
variations in the resulting systems. See page 25. ` 
e " Scale and the definition of system boundaries . are | vital but complex ee 
| questions. See” page 26. i a 


e igs! these" systems get wiser" ‘and dioste to. modeling and interacting with, 
humans, they will raise ethical and Sociological questions. The very 
world "agent" sets off complicated emotional responses. See page 27. hens 


e yere > valuable ad E Pe pie See page 29. 5 


o "Think globally; act Abaliyr"" crahslates! to ‘providing global data ac- | 
cess, but letting applications ‘make’ their seve dier The essence . 
OF self- -organization is distribute --. [ l 
“information. “Irs: ComMUTE, for one, uses 
"page 11.) The cost of maintaining central c« api 
its benefits as systems scale up, while market-style allocation schemes 
Become more erriplone (with, exceptions). NI pages 4 to ll. . 


e I -orgaits ng systems need Hx 
“munication. i _See, pages 12 to 16. 


e Careful attention must be gu to ‘the quality and latent y. (ti liness) Ed 
"of information. See pages 17 to 19. 


e Systems can evolve, but only if inefficient components are allowed to 
"die ctor Germ ine Ge yin ee aces: a 


On the next few pages we try t to describe self- -organization and address some | 
of these pointe mot ‘covered earlier. ` F5 


As noted, self- organizativ (ox emergent behavior) is a property of systems 
and results from the interaction of their individual elements. The best Way. 
to predict the pattern generated by their interaction is to simulate it. 
This "behavior" is not explicit (then it could be ‘defined precisely), but a 
system's ability to maintain itself and to adapt to unforeseen évents -- 
everything from painless assimilation of a new computer into a network to 
a a odd of sparon ban id eon a marauding Recker 


On beyond neural nets 


Self- -organization, ‘however, is different: from mere flexibility or " adaptabii- ] 
ity; it's more akin to intelligence. 'SATS to the contrary, intelligence 48. a3 
not how much you know. It's how quickly (or whether) you can learn it. P 
in this sense ‘emergent computing systems have the | potential to exhibit f : 
more intelligence than traditional expert systems, which “merely execute. | 
rules rotely, or programmed recognition systems. 
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Neural nets, by contrast, are simple emergent systems which can learn to 
recognize patterns.! Current computer based ones can't learn very much. 

A neural net is a relatively simple emergent system, because its nodes have 
very little visible behavior; they simply switch on or off. (Internally, 
the nodes adjust the weights of what may be extremely complex equations, and 
may produce extremely complex structures.) The emergent system that results 
is capable of recognizing faces or poor credit risks or (so some hope!) 
stock market patterns. : 


By contrast, a large object-oriented system consists of a lot of complex ob- 
jects, with a variety of goals that may not bear any visible relation to the 
ostensible goal of the system they’re part of. They pass complex messages 
back and forth, whereas neural nets have fixed connections and nodes that 
pass only binary signals or at best values to each other. 


. Will it take? 


O£ course, groups of objects don’t always self-organize. There may not be 
sufficient interaction, in which case the system will remain relatively 

static; each node will do its thing without instigating the sort of chain 

reaction that constitutes a self-organizing system. At the other extreme, 

there may be chaos, in both the old and the new senses of the world. There 

can be so much irregularity that no useful patterns emerge, or they may be 

so extreme as to be useless for our purposes. 


But in the happy medium the interactions result in a relatively stable sys- 
tem with periodic oscillations around steady states or evolution from state 


to state. Patterns emerge -- patterns that seem to hold far more informa- - 
tion than the objects that created them did. How can millions of Chinese, Ex 
for example, suddenly join to foment revolution -- while millions of Rus- i 


sians languish in sullen despair? This self-organized movement, unhappily, 


l Discussions of AI can get bogged down about what is "intelligent" and 
what isn't; it includes areas as disparate as explicit rule-based expert 
systems and neural-net-based pattern-recognition systems. But emergent com- 
putation concerns one specific feature of computational systems -- their 
ability to self-organize. All this raises the question of why life is 
necessarily carbon-based. What makes something alive? Is it the chemicals 
it's based on? Or how those chemicals are arranged? Or the fact that those 
chemicals arrange themselves? From a (relatively) short sequence of genes 
you can create a whole human being. By contrast, the things robots build 
are simpler than the robots themselves. . ; 


2 Yes, neural nets recognize patterns (see Release 1.0, 87-7), but they 
don't actually do anything; that's the province of expert systems and appli- 
cations. Expert systems can be programmed to make decisions based on the 
patterns recognized by a neural net; applications do whatever the. expert . 
system decides. Of course, ideally all these components are technological 
approaches that are combined in a comprehensive, composite system that does 
everything, with the partitions invisible to the casual user. Objects are 
hybrids that could just as easily contain neural-net algorithms as the pro- 
grams and data of "normal" objects. GU 
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with easing. What's the difference between smooth traffic flow and paralyz- 
ing gridlock? Between fast disk access and overloaded thrashing? 


Content counts 


Can emergent computation actually build systems more complex than what you 
put into them? That's the hope. 


What is the content of the agents that constitute them and generate such 
complex interactions?  Theoretically, the behavior of the individual com- 
ponents should be easier to specify because they are (relatively) simple 
compared to the whole. If you are building a system modeled along human in- 
teractions -- for office automation, say, or the water plant described on 
page 4, you can start with the explicit interactions among people as your 
model. Just as good expert systems don't mimic the brain but take a piece 
of its behavior (the use of explicit rules) and model that, and neural nets 
model excitations of brain cells, these systems simply take some specific 
rules of behavior and model those to produce systems capable of handling 
problems of overwhelming complexity. 


But you still have to build the logic of the local diagnostic expert system 
or decision maker or data expert into your agent. And interactions among 
people are frequently not explicit, after all (part of the reason for some 
people's discomfort with transaction-oriented groupware; Release 1.0, 88-6, 
and page 29). For example, what is the true meaning (to another computer 
agent, say) of the simple expression, "Let's have lunch"? How do you model 
the interaction it represents? The hope is that by modeling only explicit 
behaviors, you may actually get systems that run more smoothly than human 
ones. But there will also be a lot missing. 


The benefit of the model agents may be not just simplicity, but also the se- 
lection only of behaviors that are relevant and useful. You don't want your 
agents to have emotions and moods, necessarily, but you want them to have 
socially useful goals and the behavior to achieve them. So you can model 
negotiating behavior, goals, etc., without having to model whole people. 
(But that means that your models, like those of "model" economies, may be of 
limited use in predicting actual behavior of a real system.) 


Design for changing 


How do you give a program/agent rules for changing itself? "Most correct 
and well-written programs will simply break if you make even a trivial 
change," says arch-programmer Bill Joy. That's why you need a lot of them 
in a self-organizing system, so that they can cover for each other. And 
we're not (except for genetic algorithms) talking about random changes: You 
need a "grammar" for making changes, to maximize the proportion of benefi- 
cial changes and minimize the harmful ones. (Most are probably immaterial.) 


At the simplest level, you can have rules concerning data, which change the 
actions an agent takes but leave its overall behavior intact. At the high- 
est level, a language like LISP, which treats the code itself as data, makes 
it easy to write self-changing programs. (Of course, these programs are 
themselves a set of interacting objects.) In the middle is a grey area, 
where event-triggered rules change the structure of the system in which the 
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agent oparai but, the pum itself : retains its: original- fora © (In RED Boe 
system, individual agents may die out from lack of use or resources, but. 

they don't change... The result is evolution by replacement of components --.:: 
the traditional biological model.) In short, you can't define emergent be- 
havior by looking at the individual agents, but only at their interactions... 


Levels and extents:.. Choose your -cosm 


A basic issue in self-organizing systems is picking the level of abstrac- 

tion: Are you looking at a whole system, or at components. thereof? . AM 28D er 
plication consists of a.set of functions, which consist of processes... and... 
so forth, Should programs themselves. self- -organize?. Or only. systems? 2j 
Where should the active objects fit. in, ‘and where the data or passive ob- : 
jects?.. From .a pragmatic point -of view, if it's. simpler to:build something.--.: 
than to grow it,.then that's. what you. should. do. -The -goal of using emergent: 
Senputatian isto- grow. systems more complex. than. what. ‘you could: build, 


Aside from. desl: how. widely. doce: it. errana pos peepee ae of he SYS gist 
tem, or are they external forces -who. simply. program. the.agents and;set:;them:.- 
in motion? At some point, the system currency allocated to certain .of.these-. 
resources may indicate to management that it's time to buy a fourth primeert, 
or run a more cost-effective line between two workgroups...Is management: 
part o£ the „emergent. system? In this context, yesss Management's: behavior: a 
is affected. -by..interaction with its components, and. Dgusgoniene behavior :i 
turn affects the. very. nature, o£. the ET ae x anh os: 


The spirit is energent, hat, the. flesh. needs. aA; 1 Platform 


As indicated just P "Ehe: extant. of a self- Beena ayaten Wetendsu on «s 
your perspective. The system platform. can, be an interacting.part ofa: selfe 
organizing system, or it can be the environment. Emergent software a 
like, any other. software, are heir to traditional systems requirements. : E 
While. emergent systems can. be used to allocate system resources, they. then- 
selves. operate on top.of. traditional oparai rapi and Sommerer rot, 
facilities, 4n p PREIS Shvironuenssc ivi D hue riu 


The. nPitonuen. may. coupe tee a "database, eee de sob uice ecc cn oes 
self- -organizing systems, applications or system-resource managers, are the '.- 
flexible part that can usually override the imperfections and errors of the 

platform. In a small, fixed system, errors are fatal, whereas in a larger, '- 
adaptive one they can be overcome. The emergent (you might call it living) 
system. is error-tolerant; it overcomes: smelt errors: "ends ee pees big’ ones 


More anda more. of ‘the. typical REA D is: D iae virtual hardwar 
that is, fixed or. standard. . The. hardware: used: to: be the only fixed part; 
and. included. the software, which was: wired to perform particular tasks;-^ 

Then the. software became. "soft, H. and was. able to give the: same hardware a 
variety of personalities. Eventually there ‘was a separation *between ‘the © 

system software and the applications, and the system software became virtu- 
ally. "hard" once. again. AR BORSA r EE now tere ee RUM ue NEUE 
the Macintosh). . "EE ETE eio gwengslo cu mausia og E FEA 


Now, "the definition Gf pm software | £tself. is Perea to include file 
management. memory. management, even database management. "As these ‘thing 
become. standardized, they are being treated as. part of the hardware, or the 
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platform. The: problem: with: this: is. that: they lose- their capacity: to evolve. 

They may respond, but. they: don’ t- change-themselves::. : (Without: our: enedearias 
ly being-conscious of it,- we. are: part ofoinresolaeionirs ecosystem. where, t css 
systems and software are constantly evolving; we call: it. the: market.) 


Distributed and central control. 


Self-  erganletng pce are. Sealy haces oriented, ‘as a opposed’ to. ayons 

called object-oriented because they contain: objects. .In.the: latter, a:tra-:/- 
ditional procedural application calls objects as it eade them: A database 
application tool, for example, may use graphical objects. to build/a.screen' ..- 
design, or a word-processing application may treat paragraphs and words as 
objects... But generally. either. the users.or.the application logic: manipu-: srs 
lates. the: objects;: they don't. manipulate. each ;other;in.cascading.series of---- 
interactions... Of- course,- there are- degrees of.this:. Do. ‘the: objects: contain: 
procedural. code,: or does: the. procedural. flow. occasionally set. off:object ac-: . 
tivities?.. But. in. principle the. distinction: is.elear:i- | Only:a.system:of.ac-s.. 
tive objects, with. Sistributen control: exhibits; true: SUSE ESHy behavior, wae 


Take for. example. a a. eos sa as. ihe) MacroMind animation tools: Although: i 
they. create. ‚objects, with.their own behavior; the. system: is.itself- fairly © ; 
procedural: 5 MacroMind s, Director. stage-manages: the: objects;: they: do not: duc 


teract. with each: other, but rather. each runs. under. the: control: of: the cen-.' 0°: 


tral. program... «By contrast, with a-simulation (as opposed:to: animation): pro+ - 
gram such.as SimCity, the, objects: within: the-system interact with: and: affect- 
each. other. . Difficult:as.it-is-. for. programmers: to give: up: control: as: "ex 
design a system, it's much more difficult to accept that not only: will the: 
objects run under their own control, but that the system will seas are 
redesign (not just reconfigure) itself. eee 


Agents. and  amthority:; 


Reopening, a. gore. discussion, thar: cook place. at the Noçenbarn anti pou 
ing.of. Computer. Professionals for' Social Responsibility, a: pánel àát the - ; 
recent conference. on Expert. Communication. (sponsored by: the: Graphic: Communi- 
cations: Association): addressed the nature and role of: intelligent agents.. 
The original discussion was kicked off by an airing of Apple's Knowledge 
Navigator videns; NBI. known: byen now. to: ett but: eee anaes ake eines ge 


Generally,. many. people find this ape? off- S tne. for reasons vengine from ju 
excessive marketing zeal, to, sexism to.incredibility.: Our reaction is mostly ' 
aversion. to. anthropomorphism:. We.like.our:computers:to-act like: computers; Pre 
and our friends to act like people. Computers’; attempts to pass as’ people: 
are either insulting to one's intelligence (if ineffective) or aE d 
deceptiye; Sbecause the. illusion: wilh, Pe ae oreak m Uu 


What. is an. intelligent. agente. “We. canit think. of. one: Soe "than a^person:;-:o: 
such a George. Smiley... On.the. other. (hand,.a;plain.old.computer:agent/ can «c 
autono ously. carry out. reliably. any.number.of.explicit.rules: and instruc-.:- ^ 

. Properly, programmed,. it. can: react: in: useful-fashlon to:a large ‘range: :: 
of in vidually unpredictable situations,. carry out the.goals of its:/creator ' 
and adjust in specified ways.to.a.variety of. circumstances. Collections of © 
such agents may even "learn." (Yes, a collection of agents thus might con- 
stitute something close to an "intelligent agent.") 
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What's the difference between an duplication and an agente: Probably the 
same as the difference between a person and an intelligent agent. In other 
words, an agent is an application with a mission -- although the software 
agent’s mission is not its own. 


In self-organizing systems, there are lots of agents that seem to be working 
on behalf of the system itself rather than for any user in particular, and 
there are lots of agents interacting, rather than a few agents interacting 
only with the system as environment. 


Don't manipulate; delegate! 


Any application can be set up as an agent, doing a user's bidding. The 
deeper connotation of agent is an autonomous, discrete application that will 
go off and do something independently; it's the opposite of direct manipula- 
tion, where the user directs the application interactively. Instead, the 
user gives the application instructions -- whether with a language or 
through some kind of user-friendly fill-in form, prompted script or other 
tool -- and sends it off to work on its own. An agent can do its work once, 
periodically, or sit patiently in the background waiting for a triggering 
event. It can be as simple as an E-mail collector, or as complex as a junk- 
mail detector/filter or a sales manager's agent that gathers data from a va- 
riety of databases, generates a report and sends customized, personalized E- 
mail to the salespeople based on the contents of the report. (So what does 
the sales manager do? She can spend her time motivating the salespeople, 
calling on problem accounts and providing customer feedback to the product 
development group.) 


A scenario 


In the future, this agent might negotiate with other agents to plan meet- 
ings, set sales objectives, or even bargain. (The instructions could be: 
"Add 20 percent to whatever each salesperson proposes as a sales quota, and 
tell him or her that's next year's quota. Then take the average of that and 
her counteroffer as the final figure. If any salesperson refuses to con- 
firm, set up a meeting (priority 3) and send me an exception message.") 


Obviously, once a salesperson's agent figured out the salesmanager's agent's 


rules, the sales manager would have to refine her agent's rules -- by start- 
ing with a floor offer of 110 percent of last year's sales, for example. 

You can see how eventually the behavior of interacting agents -- especially 
when customers get into the act -- could become quite intricate, as envi- 


sioned by the team at PARC (page 17). 


These agents have some conditional behavior, which could be expressed as if- 
then rules. Are they expert systems? As much as any other rule-oriented 
System. Because agents act for people, and are autonomous, they will gener- 
ally include many data-driven actions rather than operate strictly proce- 
durally. But that doesn’t make them "expert" or "intelligent." It simply 
makes them capable of acting within a specified range of likely conditions. 
The last rule of any agent’s instructions should run along the lines of "If 
you encounter unforeseen conditions, get back to me." 


Release 1.0 27 June 1989 


29 


...and groupware 


( ] Groupware comes in two forms -- information-sharing systems, such as data- 

B bases and bulletin boards, and more active, transaction-oriented systems 
such as the Coordinator and Coordination Technology's forthcoming product 
(see Release 1.0, 88-6). Many people are leery of the second form because 
they incorrectly assume it's authoritarian and rigid. In terms of this dis- 
cussion, they think it's filled with government agents. But in fact group- 
ware is about user agents interacting with each other. A user, of course, 
may be a representative of top management, but in general it's old-fashioned 
hierarchical systems that have government agents, in the form of hard-coded 
rules and procedures not subject to coordination and negotiation. 


Systems and societies: Micro- and macrocosms 


You can look at communities or even the entire population of the world as 
complex systems of individual people or communities. All these are relevant 
to some kinds of inquiry. We suspect that some of the world's trade prob- 
lems are due to the propensity of some countries to act like single com- 
panies, and of some large companies to take on the trappings of government 
bureaucracies. 


While we were in the Soviet Union, we saw a system which was programmed and 
controlled by the state -- and which didn't work. A large system lacks the 
flexibility to respond to local information. You can build some of that 
flexibility in, but the goal is to build in flexibility of a higher order -- 
a system that changes itself, not just its responses, in the face of new in- 
formation. 


By modeling these systems, we can hope to determine the optimal size of, 
say, business organizations: At what point does the overhead of internal 
coordination so overwhelm things that little work gets accomplished? 


4 
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IN PRAISE OF DIVERSITY 


Diversity is the equivalent of change across a system's parts at a single 
moment, instead of across time, the usual medium of change. 


Thinking about self-organizing systems highlights the dangers of the lack of 
diversity represented by standards. Although you can build upon and extend 
standards, they enforce stasis and the end of progress in the specific areas 
they define. (Although you can build on standards, sometimes it's worth it 
to start over.) Aside from retarding improvement in a fixed environment, 
lack of diversity also leaves us vulnerable to external change -- everything 
from computer viruses to AIDS, global weather changes and the arrival of 
more efficient competitors. From a global perspective, diversity -- the 
fact that "we" included both small and large, both warm-blooded and cold- 
blooded, animals -- enabled us, the vertebrates, to survive in the face of 
whatever killed off the dinosaurs. Diversity leads to adaptability, because 
it offers a range of solutions. | 


In recent days, the Internet virus attacked (with exceptions) only machines 
running BSD 4.3 -- compelling testimony for why we don't want everyone using 
the same system. If you want to get worried, perhaps AIDS is the factor 
that will prove how similar all humans are. Mammals may survive, but this 
particular species may not. Similarly, the name UNIX may survive, but the 
particular variants espoused by OSF or UNIX International may not. (And it 
may keep the name but little else.) On the other hand, it’s nice to have a 
couple to choose from, and 08/2 is spurring both of them along from outside. 


Finally, change or no, you don't want each element of a system to have the 
same goals and behavior: For example, it's fine to have newsletter writers 
competing to be better, but if everyone were a newsletter writer there 
wouldn't be much for them to write about, no matter how finely competition 
honed their skills. Likewise, in a software system, you want specialized 
modules for specific tasks that can be called as needed. And you may want 
modules optimized for speed or for memory conservation, to be used as the 
availability of resources warrants. 


Diversity and SAA 


From this perspective, IBM may be moving in the wrong direction with SAA. 

Rather than let diversity flourish, it's attempting to obliterate the dif- 
ferences among its three broad product lines, with the result that none of 
them is optimized for any particular environment. And underlying it all, 

there's still the notion of the host controlling everything.  IBM's notion 
of cooperative processing is a PC talking to a mainframe, rather than two 

consenting POs. 


The real issue isn't to be able to run all software elements everywhere, as 
SAA would have it, but to allow all software elements to talk to one an- 
other. That is, messages should travel freely, but they should be executed 
differently by different recipients. Objects with common protocols may have 
different internal implementations, with no one the wiser. 


The correct balance (for now) is probably a variety of operating environ- 


ments connected by a variety of communications protocols and even some 
facilities such as object protocols. The Open Software Foundation, for ex- 
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ample, is currently soliciting technology for a distributed computing envi- 
ronment (page 16). This would not legislate the structure of the individual 
elements, and in fact could be the most useful part of the OSF suite, long 
after the local stuff -- UNIX or whatever sits at an individual desktop -- 
is gone. While the communications stuff itself could also improve, in this 
context it's the environment rather than the self-organizing system itself. 


Diversity in business 


The same principles can be applied to companies themselves. Competition and 
diversity are good -- but at the right level: between companies not within 
them. This leads ineluctably to the conclusion that a company is frequently 
better off funding a start-up than taking on an innovative, counter-culture 
project itself. This philosophy lies behind Lotus's recent decision to 
"restructure" its relationship with Lotus Notes -- a wonderful product that 
Lotus finds itself incapable of selling or supporting properly. The issue 
isn't the quality of the product or the size of Lotus's salesforce, but 
simply the company's ability to twist its mindset to the service of a pro- 
duct so different from the one it was built upon.  Lotus's heritage is num- 
bers and individual productivity; Notes is about text and communication and 
collaboration. 


Likewise, Cray Research's decision to split the company in two was a 
straightforward, clear-eyed recognition of the company's inability to sup- 
port two conflicting efforts managerially and emotionally. Finances were 
beside the point. 


This honest realism is refreshing in a world where everyone wonders how IBM 
can support both its proprietary SAA and the "open" UNIX standard (and 
within the UNIX camp, OSF's Motif as well as NextStep). Elsewhere, you 
could question the wisdom of Sun Microsystems' three product lines, and 
Hewlett-Packard's ability to absorb the Apollo product line and culture. 
Should Sun have bought TOPS? (On the other hand, Apple is doing fine with 
the Apple II and the Mac -- perhaps because they do not overlap at all 
anymore. But Apple was certainly smart to spin out Claris, for both ex- 
ternal and internal reasons.) 


In fact, stockholders of IBM would probably be richer right now if IBM had 
been split up by the Justice Department ten years ago. Meanwhile, former 
AT&T stockholders are doing well with their investments in the regional Bell 
operating companies carved out of the old AT&T, although the parent company 
is still fighting the aftereffects of its size and inflexibility. 


Among smaller companies, the most common malady is lack of focus, not lack 
of funds. All too often, going for market share or exploiting opportunities 
means a diversity of products for a variety of customers -- a great idea in - 
a mature market, but a dangerous dilution of effort where deep technology 
rather than breadth of product line is the key to success. Many start-ups 
die from internal competition for attention and resources long before they 
get big enough to attract competition from outside. (No examples because 
their names won't mean anything...) 


By contrast, Cray Research's John Rollwagen and the new Cray Computer's 


Seymour Cray decided the original company's two parts would be better off if 
each could be single-minded in pursuit of one system architecture. 
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The country benefits too. Now it has two supercomputer companies instead of 
one, plus the promise of a start-up founded by yet another Cray alumnus, fee 
Steve Chen, and funded by IBM. ] 


All this flies in the face of the current obsession with standards. In 
fact, the supercomputer race is far from over, and the last thing it needs 
is premature standards that would bring innovation and progress to a halt, 
or half-hearted competition between two parts of a strife-torn company. If 
the government doesn't know which effort to fund (or "protect"), so much the 
better. Let them fight it out in the marketplace. And let the government 
help them both by buying and using machines rather than with subsidies. 


This applies, of course, to other markets besides supercomputers. The best 
thing the government can do anywhere is encourage businesses to compete. 
Although Cray welcomes help against Japanese trade barriers, it's heartwarm- 
ing to see how eager it is to foster competition at home. (There's that 
-cosm issue again.) 
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RESOURCES & PHONE NUMBERS 


Mike Stock, Artificial Intelligence Technologies, (914) 347-6860 

Rob Dickerson, Borland International, (408) 439-1649 

Gary Chapman, Computer Professionals for Social Responsibility, (415) 322-3778 
Tolly Holt, Roger Moody, Coordination Technology, (203) 268-4045 

George White, Corollary, (714) 250-4040 

John Rollwagen, Cray Research, (612) 333-5889 

Dennis McEvoy, Kim Worsencroft, Cooperative Solutions, (408) 377-0300 
Eric Drexler, Foresight Institute, (415) 948-5830 

Robert Moore, Lowell Hawkinson, Gensym, (617) 547-9606 

Ann Hardy, Mary Wills, Key Logic, (408) 496-1090 

Ruann Ernst, Hewlett-Packard/OMG, (408) 447-1341 

Rusty Sandberg, Carol Realini, Bob Lyon, Legato Systems, (415) 329-7880 
Doyne Farmer, Los Alamos National Lab, (505) 667-9186 

Marc Canter, John Scull, MacroMind, (415) 442-0200 

Will Wright, Jeff Braun, Maxis Software, (415) 848-0229 or 376-6434 
Jonathan Gossels, Doug Hartman, Open Software Foundation, (617) 621-8700 
Ed Fredkin, Reliable Water Company, (508) 670-2300 

Wayne Carpenter, Mike Kennewick, Saros Corporation, (206) 646-1066 

Mike Zisman, Soft:Switch, (215) 640-9600 

Bill Joy, Sun Microsystems, (415) 960-1300 

Danny Hillis, Thinking Machines, (617) 876-1111 

Philip Lehman, Transarc Corporation, (412) 338-4400 

Duke Buster, Marek Lugowski, Texas Instruments, (214) 343-4136 

David Goldberg, University of Alabama, (205) 348-1618 

Mark Miller, Xanadu Operating Company (Autodesk), (415) 856-4382 
Bernardo Huberman, Xerox PARG, (415) 494-4147 


For further reading: 


"Grammatical Man," by Jeremy Campbell. This book is rather old, but it 
reaches back even further for a lucid exposition of (Claude Shannon's) 
information theory, and looks forward towards the generation of informa- 
tion by self-organizing systems. 


"The Ecology of Computation," assembled and edited by Bernardo Huberman, 
North-Holland, 1989. (Thanks, Brian!) This is the emergent computation 
crowd's core text. Parts of it are more readable than others, but its 
parts self-organize into a useful survey of the field. 


"The Blind Watchmaker," by Richard Dawkins (also author of "The Selfish 
Gene"), W.W. Norton, 1986. This is the basic (non-reference) text on 
the modern theory of evolution. Occasionally cute (or just English?), 
it's consistently thought-provoking. 


"Engines of Creation: The coming era of nanotechnology," by K. Eric Drexler, 
Anchor Books, 1987. This was a speaker gift at the 1988 PC Forum. It 
has more ideas per page than almost anything else we've read; emergent 
computation Is only part of it! Other topics include hypertext publish- 
ing and nanotechnology. Drexler is co-author of several of the papers 
in Huberman's book. 


"Intelligence as emergent behavior," essay by Danny Hillis in the Winter 1988 
edition of Daedalus on artificial intelligence. Also, several un- 
published papers and talks. 
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"The Society of Mind," by Marvin Minsky, Simon & Sp 1988. Our minds 
too are just (?) self-organizing systems. Written in page-size chunks, 
this book exemplifies its thesis. 


"Electronic Mail: Technology, applications and infrastructure," Soft: Switch, 
1989. 


Books we plan to read: 

"Artificial Life," edited by Chris Langton, Addison-Wesley, 1989. The pro- 
ceedings of the seminal 1987 Los Alamos workshop or artificial life, 
sponsored by the Santa Fe Institute. Including a paper by Marek 
Lugowski (page 11), "Computational metabolism: Towards biological geom- 
etries for computing," and others by Richard Dawkins, Hans Moravec, Eric 
Drexler, Steen Rasmussen and others. Also, an extensive annotated bib- 
liography. 

"Microcosm," by George Gilder, Simon & Schuster, late 1989. 


"The Dreams of Reason: The Computer and the Rise of the Sciences of Com- 
plexity," by Heinz Pagels, Simon & Schuster, 1988. 


"Proceedings of the Third International Conference on Genetic Algorithms," 
edited by J. David Schaffer, Morgan-Kaufmann, 1989. 


"Genetic Algorithms in Search Optimization and Machine Learning," by David 
Goldberg, Addison-Wesley, 1989. 


"Origins of Order: Self-Organization and Selection in Evolution," by Stuart 
Kauffman, Oxford University Press, soon. 


COMING SOON 
Xanadu. 
Europe 1992. 
A composition engine. 
CompuServe, Prodigy, MCI Mail, usernet, 
Internet, et al. The only way we know to 
get around to getting online is to commit 
ourselves to writing about them... 
Network navigation. 


Patents and copyrights. 


Object-oriented database status 
report. 


And much more... (If you know of any 
good examples of the categories listed 
above, please let us know.) 
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July 10-14 


July 17-21 


July 21-23 


July 23-25 


July 23-27 


July 24-26 


July 25-26 


July 31-August 4 


August 1-3 


August 2-3 


August 6-9 


August 8-12 
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RELEASE 1.0 CALENDAR 


*ECOOP 89 - Nottingham, England. Sponsored by the British 
Computer Society, with support from IBM Hursley and Esprit. 
Contact: Julia Allen, (011) 441 232-2551 or Joanne Walsh, 
(011) 441 637-0471. 


*CASE 89 - London. Sponsored by Index Technology and a 
host of academic groups, including London’s Imperial Col- 
lege. Contact: Elliot Chikofsky, (617) 494-8200, x 1989. 


ComputerLand vendor fair - Chicago. Sponsored by Com- 
puterLand for its dealers. Contact: Dianne Travalini, 
(415) 734-4160. 


*Sun Expo '89 - Santa Clara. Keynotes by Bill Joy and 
Scott McNealy. Sponsored by Sun Observer magazine for Sun 
users and resellers. If there is a hot UNIX box, this is 
it. Come see for yourself and meet the growing Sun com- 
munity. Contact: Clayton Peters, (408) 296-7111 or (800) 
828-EXPO. 


Information center conference and exposition - Anaheim. 
Sponsored by Weingarten Publications/Information Center 
Magazine. Keynote, Shoshana Zuboff. Contact: Martha 

Eversley, (617) 542-0146. 


Computer simulation conference - Austin, TX. Sponsored by 
the Society for Computer Simulation. Contact: Laurel 
Costello, (619) 277-3888. 


*SPARCintosh - San Francisco. The impact and implications 
of RISC-based workstations. Sponsored by the Yankee Group. 
Contact: Howard Anderson, (617) 367-1000. 


*SIGGRAPH '89 - Boston. Sponsored by the Association For 
Computing Machinery. Keynote by Nicholas Negroponte. The 
annual festival for visual, graphical thinkers. Contact 
Cindy Stark, (312) 644-6610. 


Comdex Asia/Pacific - Sydney, Australia. Sponsored by In- 
terface Group. Contact: Cheryl Delgreco, (617) 449-6600. 


Systems Integration - New York City. Sponsored by Computer 
Systems News. With Russell Hogg (formerly of MasterCard), 
Alvin Toffler, Larry Schoenberg, others. Focused on large- 
company issues. Contact: Abbey Chakalis or Irene McCarty, 
(516) 562-5417. l 


DB2 Users Group annual meeting - Chicago. Sponsored by In- 
ternational DB2 Users Group. Contact: Samantha Sipowicz, 
(312) 644-6610. 

*18th international conference on parallel processing - St. 


Charles (near Chicago), IL. Sponsored by Pennsylvania 
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August 8 


August 9-12 


August 9-11 


August 22-24 


August 22-26 


August 23-25 


chines (page 21). Contact: Peter Kogge, (607) 751-2291 
(content) or Ginny Stewart, (312) 584-6300 (logistics). 


*Software development law '89 - Boston. Sponsored by law 
firm Elias and Goodman to precede MacWorld and targeted at 
Mac developers. Not just theory; this conference will have 
Apple reps talking concretely about such issues as use of 
the Mac name, HyperCard and HyperTalk, Apple software 
patents, etc. Speakers include Adam Osborne, Rachel 
Parker, Dan Bricklin and Dave Winer. Contact: Paul Good- 
man, (212) 421-6022 or Wes Thomas, (516) 266-1652. 


*Macworld Expo - Boston. Keynotes: John Sculley, Jean- 
Louis Gassee, Alan Kay. Contact: Peggy Kilburn, (617) 
326-9955. 


*Conference on object-oriented dbms applications - Santa 
Clara, CA. Sponsored by Santa Clara University. Contact: 
Mohammed Ketabchi, (408) 554-2731 or mketabchi@scu.bitnet. 


Summer UniForum - Boston. The regional version. Sponsored 
by /usr/group. Contact: Ed Palmer, (408) 986-8840. 


IJCAI-89 - Detroit. The international version of AAAT. 
Sponsored by the American Association for Artificial Intel- 
ligence. Contact: Claudia Mazzetti, (415) 328-3123. 


TechDoc '89 - San Jose. "Publishing in the '90s...the art 
of publishing and the science of information management," 
Technical documentation and all its ramifications, includ- 
ing hypertext. Keynote: Jim Barksdale of Federal Express 
(a real treat!). Sponsored by Graphic Communications Asso- 
ciation. Contact: Patti Hill, (703) 841-8160. 


August 24-September 1 *Eleventh World Computer Congress - San Francisco. 


September 6-9 


September 7-10 


September 10-13 
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With a focus on tools and application software this year; 
in the U.S. for the first time in 24 years. Sponsored by 
46 IFIP member societies. Call Nancy Dana, (303) 696-6100. 


Breakaway '89 - Orlando. Sponsored by ABCD, the micro- 
computer industry association (mostly dealers). Contact: 
Deborah Keating, (312) 240-1818. 


Comtec '89 - Singapore. Regional micro exhibition.  Spon- 
sored Microcomputer Trade Association of Singapore.  Con- 
tact: Yong Mee Hiong, Singapore 2913238; fax 2965384. 


ITA 21st annual convention/exhibition - New York City. 
Sponsored by Information Industry Association. Keynote: 
Bob Maxwell of Maxwell Communications. Also, Gerry Cohen 
of Information Builders, David Liddle of Metaphor, Rick 
Crandall of Comshare, Carter Bales of McKinsey. Contact: 
Mike Atkin, (202) 639-8262. 
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September 


September 13-15 


September 17-21 


September 18-20 


September 18-22 


September 19 


September 20-23 


September 21 


September 21-22 


September 24-26 


September 27-28 


September 27-29 
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NetWorld - Dallas. Managed by H.A. Bruno. 
Torres at (201) 569-8542 or (800) 444-EXPO. 


Contact: Adam 
*Conference on Computer-Supported Cooperative Work - London 
(Gatwick). Inspired by the successful U.S. events, but 


likely to focus even more on social issues. Contact: 
Lorna Meek, 011 44 (753) 73232. 


Managing the corporate personality for the nineties - 
Martha's Vineyard. Sponsored by Design Management In- 
stitute. With speakers from Xerox and Danish State Rail- 
ways, among others. A broadening, useful conference. Call 
Nancy Barry, (617) 236-4165. 


DataStorage - San Jose. Sponsored by DISK/TREND and Free- 
man Associates. Call Darlene Plamondon, (408) 554-6644, 


*Third international conference on human-computer interac- 
tion - Boston. Sponsored by Association of American Pub- 
lishers, Bechtel National, IBM, Purdue and the U. of 
Wisconsin-Madison. Contact: Myrna Leap, (317) 494-5426. 


Interface Design '89 - San Francisco. Sponsored by Mac- 
Week, in hopes of consistency if not necessarily standards. 
Contact: Cindy Koral at (415) 243-3315. 


Seybold computer publishing conference - San Francisco. 
Sponsored by Seybold Publications. The usual extravaganza, 
expanded from desktop publishing to include all electronic 
publishing. Contact: Kevin Howard, (213) 457-5850. 


*Microcomputer Managers Association meeting - New York 
City. Keynote by Esther Dyson. Contact: Priscilla Tate- 
Austin, (201) 580-9091. 


*Microprocessor Forum - San Jose. Repeat of last year's 
deserved sellout. Speakers include John Hennessy, Andy 
Heller, Andy Bechtolsheim, Nick Tredennick and other macro- 
minded micro folk. Sponsored by Microprocessor Report. 
Contact: Michael Slater, (415) 494-2677. 


*Agenda 90 - La Costa, CA. Sponsored by P.C. Letter/PCW 
Communications; staged by Stewart Alsop. Contact: Tracy 
Beiers, (415) 592-8880. 


Portable Computing '89 - New York City. Sponsored by Port- 
able Computer Review, Traveling Software and Hajar Assocía- 
tes. Keynote by Chris Demos of Federal Express, a stra- 
tegic user of such systems. Contact: Kathleen Duris at 
IDG Conference Management, (508) 879-6700. 


Second CASE users conference - Monterey. Sponsored by CASE 


Research Corporation.  Vendor-independent users' confer- 
ence. Contact: Debbie Boren, (206) 453-9900. 
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October 1-4 


October 1-4 


October 2-6 


October 2-6 


October 2-6 


October 3-5 


October 10-13 


October 11-14 


October 16-19 


October 25-27 


*ADAPSO Management Conference - Orlando. 


Mingle with your 
peers (and Disneyworld's nearby just in case). Contact: 
Sheila Wakefield, (703) 522-5055. 


*Alex. Brown Computer Services Seminar - Baltimore. The 
tenth annual... Contact: Rivka Hawk or Ellen Kempler, 
(301) 727-1700. 


*OOPSLA - New Orleans. Sponsored by ACM/SIGPLAN. Come 
meet your fellow objects and share procedures. Send a mes- 
sage to Carole Mann, (407) 628-3602. 


CD-ROM Expo - Washington, DC. Sponsored by IDG Conference 
Group. Contact: Mitch Hall, (617) 329-8090. 


Interop 89 - San Jose. Interoperability made tangible, 
with tutorials, discussions, product demos and pitches. 
Sponsored by Advanced Computing Environments. Contact: 
Mark Belinsky, (415) 941-3399. 


PC Expo - Chicago. Sponsored by PC Expo. Contact: Steven 
Faher, (800) 444-EXPO or (201) 569-8542. 


Info 89 - New York City. Sponsored by Cahners Exposition 
Group. Contact: Frank Fazio or Kerry Gumas, (203) 964- 
0000. 


*Software Publishers Association annual conference - Mon- 
treal. Call Jayne White, SPA, (202) 452-1600. 


EDUCOM - Ann Arbor, MI. Call Joan Davis, (609) 520-3340. 
*SGML applications conference - Washington, DC. Sponsored 


by Graphic Communications Association. Contact: Norman 
Scharpf, (703) 841-8160. . 


October 30-November 1  *Seventh annual Seybold Executive Forum - Boston. 


November 1-3 


November 5-10 
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Sponsored by Patty Seybold's Office Computing Group.  Con- 
tact: Deborah Hay, (617) 742-5200 or (800) 826-2424. 


*UNIX expo - New York City. Keynote by noted UNIX fan Ken 
Olsen of DEC. Managed by National Expositions Co. Con- 
tact: Roger Halligan or Heidi Dethloff, (312) 332-4650 or 
(212) 391-9111. 


*Hypertext '89/SIGDOC 89 - Pittsburgh, PA. Much larger, 
for better or worse, than the first, wonderful hypertext 
conference in the fall of '87. Hypertext covers the first 
three days; SIGDOC the last three. Sponsored by ACM. Con- 
tact: Elise Yoder at (412) 327-8181 for Hypertext '89; 
Mike Dolhi or Adam Young at Scribe Systems, (412) 281-5959 
for SIGDOC 89. (How about a joint committee on standards 
for the use of apostrophes?) 
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November 13-15 


UIST - Williamsburg, VA. Symposium on user interface soft- 
ware and technology, sponsored by ACM SIGGRAPH and SIGCHI. 
Contact: John Sibert, (202) 994-4953. 


November 13-17 . *Comdex - Las Vegas. Also including MACdex. Gontact: 
Jane Wemyss at (617) 449-6600 or (800) 325-3330. 


December 4-6 *First international conference on object-oriented and 
' deductive databases - Kyoto. Sponsored by IEEE, MCC, many 
others. Contact: Professor Kiyoshi Agusa, 011 81 75 256- 
1677 or Won Kim at MCC, (512) 338-3439. 


1990 


January 17-19 Western computer simulation multi-conference - San Diego. 
Sponsored by the Society for Computer Simulation with ACM, 
IEEE, et al. Contact: Laurel Costello, (619) 277-3888. 


January 22-25 *UniForum - Washington, DC. Sponsored by UniForum, former- 
ly /usr/group. "UNIX in the 90s -- Decade of the user." 
Contact: Ed Palmer, (408) 986-8840. 


January 28-31 *kEDventure Holdings PC (Platforms for Computing) Forum - 
Tucson, AZ. Sponsored by us! Note that it's earlier this 
year. Contact: Daphne Kis, (212) 758-3434. 


February 20-22 Computer science conference - Washington, DC.  "Coopera- 
l tion" is the theme, among processing units, technologies, 
disciplines. Sponsored by ACM. Contact: Barbara 
Kyriakakis, (703) 323-2318. 


February 22-25 Technology entertainment design conference - Monterey. 
Sponsored by Pacific Bell Directory. A multi-personality 
event with John Sculley, Alan Kay, Jaron Lanier, Herbie 
Hancock, Kenny Rankin, Ted Nelson. Contact: Mike Whit- 
acre, (213) 832-9396. 


March 5-9 *Seybold Seminars '90 - Boston. ...moves east. Call Kevin 
Howard, (213) 457-5850. 


April 10-13 *Macworld - San Francisco. Later this year. Call Peggy 
Kilburn, (617) 326-9955. 


Please let us know about any other events we should include. 
-- Denise DuBois 


*The asterisks indicate events we plan to attend. Lack of an asterisk 
is no indication of lack of merit. l 
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